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Note  on  degeneracy 

By  A.S.Krishna,  Stanford  University 

r"'  ^  i---  r  ^ 

\  Abstract 

Given  a  linear  program  in  standard  form,  Min  CX  S.t.  Ax  =  6,  X  ^  0,  where' A  is 
an  m  X  n  matrix  wkh  rational  coefficients,  one  technique  t^ed  to  resolve  degeneracy 
in  the  simplex  algorithm  is  the  lexicographic  rule.  This  rule  adjoins  to  6  a  non-singular 
m  X  m  square  matrij^  M.  The  appended  columns  of  M  are  updated  along  with  b  on 
each  iteration.  When  the  ratio  test  for  determining  the  pivot  ^ow  results  in  a  tie,  the 
ratio  test  is  applied  to  t|he  corresponding  elements  of  the  updated  columns  of  in  turn, 
from  left  to  right,  until  the  tie  is  resolved.  In  this  note  we  prove  that  it  is  only  necessary 
instead,  to  adjoin  to  6  a  single  column  d  whose  ith  component  is  rfj  =  ,  (  or  preferably 

the  fractional  part  of-^f^in  order  that  |rfi)  <  1).  Any  transcendental  number ^  - 
-4^=-5r73  .  .  .  ^the  base  of  the  natural-logirthnvcan  be  used  instead  of  7r  =  3.14  .  .  .  . 

The  proof  exploits  the  fundamental  property  of  a  transcendental  number  namely,  it 
can  never  be  a  root  of  a  polynomial  equation  QsifT  +  Oe£^  +  •  ■  •  +  OcpX^  =  0  when 
5  » •  •  •  >  rational  and  not  all  zero.  _ .  - - 
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_  ...  > 

Review  of  standard  e  —  perturbation  method  or  lexicographic  rule  :  /  ,  _ ^ 

In  €-perturbation  method  we  perturb  the  RHS  to  (fei  +  e,  62  +  e^, . . . ,  6^  +  e”*). 
At  any  iteraton  the  right  hand  side  is  (61  +  Pi(e), . . . ,  6^  +  Pm(^))  where  pj  is 
the  polynomial  where  0  stands  for  the  inverse  of  the  basic  matrix 

in  the  curent  iteration.  Given  the  variable  entering  basis,  it  can  be  proven  that 
3  Co  >  0  such  that  V  0  <  €  <  ep,  the  variable  that  leaves  the  basis  is  uniquely  de¬ 
termined.  Moreover  this  lexicographic  rule  for  choosing  the  entering  basic  variable 
solves  the  original  problem  in  finitely  many  iterations.  Tlie  key  point  in  the  proof  is 
based  on  the  observation  that  at  any  iteration  the  polynomials  for  i  = 

1, . . . ,  m  are  independent,  in  the  sense  that  no  non-zero  linear  combination  of  them 
is  identically  equal  to  zero.  This  implies  that  for  any  choice  of  0  <  e  <  eo,  no  two 
rows  can  be  tied. 
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However  perturbing  in  this  way  requires  updating  the  full  matrix  M~^  =  [f3ij] 
and  possibly  making  many  comparisons  since,  in  the  worst  case,  we  might  have  to 
compare  elements  of  m  additional  columns.  However,  when  all  entries  in  the  initial 
tableau  are  rational,  we  propose  a  different  perturbation  scheme  which  requires  the 
updating  and  comparisons  in  case  of  ties  in  exactly  one  additional  column.  Moreover 
this  column  does  not  depend  on  the  values  of  A  or  6  and  is  the  same  for  all  problems 
with  m  rows. 
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Towards  that  end  let  us  suppose  that  all  entries  of  the  initial  tableau  are  ra¬ 
tional.  We  perturb  the  RHS  to  (6i  +  diC, . . . ,  6^  +  d„,e)  where  di, . . . ,  will  be 
specified  later.  At  any  subsequent  iteration  t,  let  the  updated  RHS  be  hi  -|-die,  62  + 
d2€, . . .  ,bfjf  +  dfn^.  The  values  of  hi  and  dj  can  be  found  by  standard  pivot  up¬ 
dating  or  derived  from  the  original  tableau  by  the  formula  ^ikbk  and 

dj  =  Yli.^ikdk  for  i  =  l,...,m  where,  as  usual,  /?  stands  for  the  inverse  of  the 
current  basis  matrix. 

We  want  to  choose  the  coefficients  d  =  (di, . . , ,  d„,)  so  that  for  any  subsequent 
iteration  t,  either  6i  >  0  or  6i  =  0  and  dj  >  0.  To  find  such  a  d,  we  note  that  if 
A  consists  of  all  rational  entries,  then  ail  subsequent  basis  inverse  elements  j3ij  are 
guaranteed  to  be  rational.  Hence  it  is  enough  to  choose  di, . . . ,  d^  s.t.  ctkdk  ^  0 
whenever  all  otk  are  rational  except  if  Ofc  =  0  for  all  k  .  This  is  easily  accomplished 
by  choosing  d*  =  d*  where  d  is  any  transcendental  number,  say,  tt  =  3.14156. . . 
for  example.  In  that  case  the  requisite  property  is  satisfied  by  any  transcendental 
number,  indeed  this  is  the  definition  of  a  transcendental  number. 

To  summarize,  the  following  perturbation  scheme  involves  less  updating  and 
smaller  possible  number  of  comparisions  than  the  conventional  lexicographic  scheme 
and  guarantees,  in  the  case  of  a  rational  problem,  finite  termination. 

Apply  the  simplex  method  with  the  following  choice  of  the  variable  leaving  the 
basis.  First  append  to  the  RHS  the  column  d  =  (tt,  tt^,  . . .  ,7r'”)  or  alternatively 
d  =  (di, . . . ,  d„,)  where  dj  is  the  fractional  part  of  tt’.  For  some  subsequent  iteration 
let  i4,6,c,  d  denote  the  elements  of  the  current  tableau  where  d  is  the  updated 
column  d  which  is  appended.  Then  the  steps  are: 


STEP  1;  s  =  argmin(c;) 

j 

STEP  2:  If  Ca  '>  0,  terminate. 

(current  basic  feasible  solution  is  optimal) 

STEP  3:  Denote  hy  R=  {t|dia  >  0}. 

If  R  is  empty,  terminate. 

obj(current  basic  solution  -|-A  homogeneous  solution)— >  —00 
as  A  — >  -hoo 

STEP  4:  Denote  by  ii  =  {k  ^  <  bi/oig  V  i  €  R} 

r  ixigi-n^ (dk/dks) 

k  e  R 

STEP  5:  Update  tableau  by  pivoting  on  Or*. 

STEP  6:  GO  TO  STEP  1. 
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The  above  proof  is  valid  if  the  coefficients  are  rational  and  the  computations 
are  carried  in  exact  arithmetic.  As  for  the  case  of  irrational  coefficients  the  following 
observation  can  be  made:  Given  ziny  table,  there  are  only  finitely  many  tables  which 
can  be  generated  from  it  by  pivoting.  So  altogether  there  are  only  coimtably  many 
tables  that  might  show  up  at  some  point.  So  perturbing  the  RHS  to  (6i+de, . . . ,  6,„  + 
d"*e),  we  get  coxmtably  many  polynomials  in  d  that  might  show  up  as  coefficients 
of  e  in  RHS.  So  surely  3  dg  which  is  not  a  root  of  any  of  these  polynomials.  Hence 
choosing  such  a  d  =  dg  can  never  result  in  a  tie  for  the  choice  of  pivot  row  since, 
having  a  tie  at  some  iteration  implies  having  0  in  the  next  iteration,  which  we  have 
just  ruled  out. 

For  the  case  of  irrational  coefficients  all  this  is  not  of  much  practical  significance, 
since  there  appears  to  be  no  practical  way  of  finding  such  an  dg .  Moreover  we  need 
not  worry  too  much  about  this  case  in  practice  since  all  practical  problems  are 
rational,  i.e.,  only  rationals  can  be  represented  on  a  computer.  This  same  criticism 
applies  in  the  rational  case  as  well  since,  from  a  practical  point  of  view,  neither  can 
a  transcendental  like  tt  or  e  be  represented  on  computer. 

Theoretically  we  have  finite  termination  with,  say,  tt.  Therefore  we  have  finitely 
many  poly  nomails  in  d  as  coefficients  of  e  for  which  n  was  not  a  root.  Hence  no 
number  in  a  small  neighbourhood  of  tt  can  be  root  for  those  polynomials  either. 
So  representing  tt  sufficiently  accurately  does  the  trick,  though  once  again  from  a 
practical  point  of  view  we  can  not  determine  o  priori  how  much  accuracy  is  sufficient 
and  whether  requiring  that  much  accuracy  is  worthwhile  or  not. 

Another  point  of  practical  concern  is  computing  the  powers  of  tt.  If  m  is  large  it 
is,  of  course,  not  advisable  to  compute  and  store  tt”*  in  a  computer.  Instead  we  can 
still  have  rational  independence  of  polynomials  as  explained  above  if  we  choose  our 
di,d2, . . .  ,djn  as  follows.  Define  dg  =  1,  then  d,  =  7rd,_i  —  [7rd,_i]  for  i  =  1, . . . ,  m 
where  [7rd,_i]  denotes  the  greatest  integer  less  than  or  equal  to  7rd,_i.  In  a  computer 
TT  is  replaced  by  W,  the  first  p  significant  digits  of  tt;  moreover  d,  is  replaced  by  d,, 
the  first  q  significant  digits  of  dj.  It  is  therefore  possible,  due  to  rounding,  that 
dj  =  di+k  for  some  i  and  n:  >  0.  If  this  is  the  case  the  sequence  of  dj  will  cyclically 
repeat.  To  test  this  possibility  we  generated  {dj}  for  i  =  1, . . .  ,5000,  where  tt  was 
replaced  by  7r,  the  first  16  digits  of  tt  and  all  the  arithmetic  was  carried  to  16  decimal 
places.  No  repetition  was  found  in  the  sequence. 
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Abstract 

Given  a  linear  pingram  in  standard  form,  Min  CX  s.t.  Ax  =  6,  X  >  0,  where  A  is 
an  m  X  n  matrix  with  rational  coefficients,  one  technique  used  to  resolve  degeneracy 
in  the  simplex  algorithm  is  the  lexicographic  rule.  This  rule  adjoins  to  b  a  non-singular 
m  X  m  square  matrix  M .  The  appended  columns  of  M  are  updated  along  with  b  on 
each  iteration.  When  the  ratio  test  for  determining  the  pivot  row  results  in  a  tie,  the 
ratio  test  is  applied  to  the  corresponding  elements  of  the  updated  columns  of  M  in  turn, 
from  left  to  right,  until  the  tie  is  resolved.  In  this  note  we  prove  that  it  is  only  necessary 
instead,  to  adjoin  to  6  a  single  column  d  whose  ith  component  is  dj  =  TT* ,  (  or  preferably 
the  fractional  part  of  TT*  in  order  that  |<fjj  <  1).  Any  transcendental  number,  like 
e  =  2.73  •  ■  .  ,  the  base  of  the  natural  logirthm,  can  be  used  instead  of  TT  =  3.14 .  .  .  . 
The  proof  exploits  the  fundamental  property  of  a  transcendental  number  namely,  it 
can  never  be  a  root  of  a  polynomial  equation  CXiX  +  Oi2X^  "!■•*•+  CtpX^  =  0  when 
tki ,  0(2, .  •  •  ,  CXp  are  rational  and  not  all  zero. 
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